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Abstract 

<N ; 

In this paper, a lower bound is determined in the minimax sense for change point estimators 
of the first derivative of a regression function in the fractional white noise model. Similar 
Q\ \ minimax results presented previously in the area focus on change points in the derivatives 

of a regression function in the white noise model or consider estimation of the regression 
function in the presence of correlated errors. 
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1. Introduction 

Nonparametric estimation of a kink in a regression function has been considered for Gaus- 



> 

OV 

sian white noise models by Cheng and Raimondo (2008); Goldenshluger, Juditsky, Tsybakov, and Zeevi 
OO 

in 

o 



(2008a,b). Recently, this was extended to the fractional Gaussian noise model by Wishart 
(2009). The fractional Gaussian noise model assumes the regression structure, 

dY(x) = n{x)dx + e a dB H (x), x e R, (1) 



where Bh is a fractional Brownian motion (fBm) and /i : R — > R is the regression function. 
S^ . The level of error is controlled by e x n~ l * 2 where the relation a n x b n means the ratio a n /b n 

is bounded above and below by constants. The level of dependence in the error is controlled 
by the Hurst parameter H G (1/2, 1) and a := 2 — 2H, where the i.i.d. model corresponds to 
a — 1. The fractional Gaussian noise model was used by Johnstone and Silverman (1997); 
Wishart (2009) among others to model regression problems with long-range dependent errors. 
This paper is interested in the performance of estimators of a change-point in the first 
derivative of \x observed in model (1). This type of change point is called a kink and the 
location denoted by 9. Let 9 n denote an estimator of 9 given n observations. A lower bound 
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is established for the minimax rate of kink location estimation using the quadratic loss in 
the sense that, 



lim inf inf sup p n 2 E 



?n /x6.F s (0) 



On — 



> C for some constant C > 0. (2) 



The main quantity of interest in this lower bound is the rate, p n . In (2), inf^ denotes the 
infimum over all possible estimators of 9. The class of functions under consideration for \x is 
denoted & s {@) and defined below. 

Definition 1. Let s > 2 be an integer and a£l\ {0}. Then, we say that \x G <^ s {9) if, 

1. The function fj, has a kink at 9 G (0, 1). That is, 

limu' '(i) — lim/r mx) =a^0. 

2. The function p G 5£<i (R) fl Jzfi(M), and satisfies the following condition, 

\Ji(cu)\\oj\ s du < oo, (3) 



where /I(w) := L e 27TluJx n(x) dx is the Fourier transform of \i. 

The minimax rate for the kink estimators has been discussed in the i.i.d. scenario by 
Cheng and Raimondo (2008); Goldenshluger et al. (2008a) and was shown to be n~ s ^ 2s+1 \ 
An extension of the kink estimators to the long-range dependent scenario was considered 
in Wishart (2009) that built on the work of Cheng and Raimondo (2008). An estimator of 
kink locations was constructed by Wishart (2009) and achieved the rate in the probabilistic 
sense, 

9 n -9 =O p {n- as ^ 2s+a ^), (4) 



'a 



which includes the result of Cheng and Raimondo (2008) as a special case with the choice a = 
1. Both Cheng and Raimondo (2008) and Wishart (2009) considered a comparable model in 
the indirect framework and used the results of Goldenshluger, Tsybakov, and Zeevi (2006) 
to infer the minimax optimality of (4). However, the results of Cheng and Raimondo (2008) 
and Wishart (2009) require a slightly more restrictive functional class than & s {9). The rate 
obtained by Cheng and Raimondo (2008) of n~ s ^ 2s+1 ^ was confirmed as the minimax rate 
by the work of Goldenshluger et al. (2008a) who used the i.i.d. framework and a functional 
class similar to ,^ s {9\ 

The fBm concept is an extension of Brownian motion that can exhibit dependence among 
its increments which is typically controlled by the Hurst parameter, H (see Beran (1994); 
Doukhan, Oppenheim, and Taqqu (2003) for more detailed treatment on long-range depen- 
dence and fBm). The fBm process is defined below. 

Definition 2. The fractional Brownian motion {BH{t)} t£R is a Gaussian process with mean 
zero and covariance structure, 

EB H (t)B H (s)= 1 -{\t\ 2H + \s\ 2H -\t-s\ 2H }. 



We assume throughout the paper that H £ (1/2, 1), whereby the increments of Bh are 
positively correlated and are long-range dependent. 

In this paper a lower bound for the minimax convergence rate of kink estimation using 
the quadratic loss function will be shown explicitly on model (1). This is a stronger result in 
terms of a lower bound than the simple probabilistic result in (4) given by Wishart (2009) 
and is applicable to a broader class of functions. 

2. Lower bound 

The aim of the paper is to establish the following result. 

Theorem 1. Suppose \x £ ^ s {9) is observed from the model (1) and < a < 1. Then, 
there exists a positive constant C < oo that does not depend on n such that the lower rate of 
convergence for an estimator for the kink location 9 with the square loss is of the form, 



liminfinf sup n 2 W(2s+«) E 
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From Theorem 1 one can see that the minimax rate for kink estimation in the i.i.d. case 
is recovered with the choice a = 1 (see Goldenshluger et al., 2008a). Also unsurprisingly, the 
level of dependence is detrimental to the rate of convergence. For instance as the increments 
become more correlated, and a — > 0, the rate of convergence diminishes. 

As will become evident in the proof of Theorem 1 the Kullback-Leibler divergence is 
required between two measures involving modified fractional Brownian motions. To cater 
for this, some auxiliary definitions to precede the proof of Theorem 1 are given in the next 
section. 

3. Preliminaries 

In this paper, the functions under consideration are defined in the Fourier domain (see 
Definition 1). Among others, there are two representations for fBm that satisfy Definition 2 
that are used in this paper. The first being the moving average representation of Mandelbrot and Van Ness 
(1968) in the time domain and second is the spectral representation given by Samorodnitsky and Taqqu 
(1994) in the Fourier domain. These both need to be considered since they are both used 
in the proof of the main result. Both representations have normalisation constants Ct,h 
and Cf,h for the time and spectral representations respectively to ensure the fBm satisfies 
Definition 2. Start with the time domain representation. 

Definition 3. The fractional Brownian motion {5^(t)} teffi can be represented by, 
where C t ,h = T(H + l/2)/y/2H sm(nH)T(2H) and x+ = xl {x>Q} (x 



B«(t) = -—/(*- s)»- 1/2 - (-s)r V ) dB(s), 

<^T,H J] 



For the spectral representation a complex Gaussian measure B := B*- 1 * + iB^ is used 
where B^ and B^ are independent Gaussian measures such that for i = 1,2; -B^(A) = 
B^(—A) for any Borel set A of finite Lebesgue measure and K(B^(A)) 2 = mesh(A)/2. 

Definition 4. The fractional Brownian motion {BH{t)} t£ ^ can be represented by, 

Bn{t) = J- / ^^l\s\-<*-WdB(8), 

^F,H JR. lS 



where C F , H = ^tt/(2H sin(TrH)T(2H)). 

As will become evident in Section 4, to obtain the lower bound result for the minimax 
rate, it is crucial to know which functional class to consider for \x : K. — > M. such that the 
process j R fi(x) dBn{x) is a well defined random variable with finite variance. Two such 
classes of functions will be considered, % and "H, which correspond to the time and spectral 
versions of fBm respectively. Begin with the moving average representation. 

Definition 5. Let H e (1/2, 1) be constant. Then the class H is defined by, 



n = {fi: 



fx(x)fx(y)\x — y\ a dydx<oo 



Simlar to (5) there is an inner product on the space % that satisfies the following. For 
all f,geH, 



E / f(x)dB H (x) / g{y)dB H {y)\=C a / / f(x)g(y)\x - y\~ a dydx =: (f,g) n 




where the constant C a = |(1 — a) (2 — a). The other functional class for the spectral 
representation is denoted by % and defined below. 

Definition 6. Let H G (1/2, 1) be constant. Then the class % is defined by, 



n = {n 



\jl{uj)\ 2 \u\- {1 ~ a) du 



< oo 



On the space %, the stochastic integrals with respect to fBm are well defined and satisfy 
the following. For all f,gET~L, 



E / f(x)dB H (x) / g(y)dB H (y) \ = -^- / /(«)flf(«)|«|-^ a >da; =: (f,g) n , (5) 

iJR JR J ^F,H -/R 

where g denotes the complex conjugate of g. 

These two classes of integrands were considered extensively in Pipiras and Taqqu (2000). 
In this context of this paper the inner products can be used interchangeably because if 
fj. E & 8 (6) then /j, e JSfi(K) n JSf 2 (R) and by Pipiras and Taqqu (2000, Proposition 3.1) 
then n 6 %. Also, using Pipiras and Taqqu (2000, Proposition 3.2) with the isometry 
Biagini et al. (2008, Lemma 3.1.2) and Parseval's Theorem then /i e % and consequently 



4. Proof of Theorem 1 

The lower bound for the minimax rate is constructed by adapting the results of Goldenshluger et al. 
(2006) to our framework. This requires obtaining the Kullback-Leibler divergence of two 
suitably chosen functions /io and /ii from the functional class & s {&). The main hurdle in 
determining the Kullback-Leibler divergence is the long-range dependent structure in the 
fBm increments. A summary of Girsanov type theorems for fBm have been established 
by Biagini, Hu, 0ksendal, and Zhang (2008, Theorem 3.2.4). Here however, the Radon- 
Nikodym derivative is the main focus. Once that is determined, the Kullback-Leibler diver- 
gence is linked to the lower rate of convergence using Tsybakov (2009, Theorem 2.2 (hi)). 
Lastly, before proceeding to the proof, the quantity C > denotes a generic constant that 
could possibly change from line to line. 

Without loss of generality, consider a function /i G ^(#0) where #0 G (0, 1/2] and define 
#1 = 0q + 5 where 5 G (0, 1/2) (a symmetric argument can be setup to accommodate the 
case when #0 G [1/2, 1))- Define the functions v : M. — >M. and vn '■ K — ^R such that 

/N 
v(u)e 2nixuj du, 
-N 

where a is the size of the jump given in Definition 1 and v is the Fourier transform of 
v. Note that, vn(x) is close to v(x) in the sense that it is the inverse Fourier transform 
of u(w)1i w |<jv and Vn(u) = v(oj)1\ u \<n- With these definitions, the derivative takes the 
form, v^(x) = al[e 0j e 1 i(a;) and the function (/a — v) has a single kink at 9±. Then define 
/ii := /io — (v — vn). The function vn is infinitely different iable across the whole real line 
and smooth for finite N, which implies that \i\ = /io — (v — vn) has a single kink at 9\. It 
can be shown that, 

\v{oj)\<a5/{2-K\uj\)- 1 . (6) 

Further, if N is chosen to be N = (sirC/(a5)) then J R \vn(uj)\\uj\ s du < 00 and conse- 
quently /ii e ^ s (&i). 

To be able to determine the Radon-Nikodym derivative, define A := /x — \i\ = v — v n 
and note that A : K — y R. The Radon-Nikodym derivative also needs a paired function 
A : K — y R. Define such a function with a singular integral operator with 

A(x) := e~ a C a f\x- y\- a A(y) dy = T ( 3 ~ ^ (vZ (1 ' a) A(x) + P; (1 - q) A(x)) , (7) 



where, for v G (0, 1), T>_ v and T> + v are the left and right fractional Liouville integral operators 
defined by, 

1 r x 1 r 00 

Vl»f(x):=—J (x-yr 1 f(y)dy V~ v f{x) := — J (y - x)^ 1 f (y) dy 

This function A has representation in the Fourier domain with 

AMxe- a lwl 1 - a AM. 



Furthermore, A G H fl "H. Indeed, by definition, A = /i — A*i with /x G ^s(^o) an d 
/ii G #5(6*1) which implies that A E JS?i(R) n Jz? 2 (K) and A(w) = o(w~ s ) due to (3). First, 
it will be shown that, AgW. 

(A,A)^x /'|A(u;)rV| 1 - a dw 

Jr 

<c\\\A\\l[ \u\ 1 ~ a du + f \K(u)\ 2 \uj\ l - a du 

where C > is some constant and ||A||i = f R |A(x)| dx. In (8), the first integral is finite 
since a G (0, 1) and the last integral is finite since A (a;) = o{uj~ s ) for s > 2, proving A G "H. 
Then apply the isometry in Biagini et al. (2008, Lemma 3.1.2) with Plancherel and (8), it 
follows that A G U. 

Now let P and Pi be the probability measures associated with model (1) with /1 = /i 
and /i = /ii respectively. Define, Bh(x) ■— e~ a J A(x) dx + P>h{x). Then under the Po 
measure, 

dYo(x) = fJ>o(x) dx + e a dBn(x) = Hi(x) dx + e a dBnix). 

The Radon-Nikodym derivative between these measures takes the form, 



^ := exp <j - ^ A(x) dB H {x) - ^E Po ( / A(x) dB H {x] 



(9) 



Indeed to show (9) is valid, for A G "H and ip G "H, use (7) and apply Biagini et al. (2008 
Lemma 3.2.1) with the change of measure formula in (9) to yield, 

dP x ~ 



E 



Fl 



HB H (x)) 



E 



Po 



if>(B H (x)) 



dP 



E 



Po 



i>{B H (x)) 



(10) 



So, using (5) in (9), the Kullback-Leibler divergence between the two models can be evalu- 
ated, 

dP 1 

/C(P ,P 1 ):=Eln^ = -(A,A)^. (11) 

To evaluate (11), obtain a finer bound on |A(u;)| 2 by recalling that A = v — vjy and using 
(6), 



1AM 



-2a \ 



w(w)| 2 l { | w |>7v } |u; 



2-2o- 



< 



C 2 a 2 5 2 



e -2a| w |-2a 1 



47r 2 l~l ^IM^}- 

Apply the bound in (12) to (11) with the chosen N = (sttC / (a5)) , 

1 

2. 
Ca 2 <5 2 



'121 



/c(p ,Pi; 



|A(w)| 2 |w|- (1 - a) dw 



< 



-5 



-2a 



4tt 2 
CaVe" 2 " (s/ (<**)) 

j(2 S +a)/s £ -2a_ 



1— a— 1 r 

U)\ du 



u\>N 
2 jj-2_ -2a /■„ l/„s;\\-a/s 



6 



Now choose 5 x £ 2as /( 2s + a ) which guarantees that K,(Pq, Pi) < K < oo for some finite 
positive constant K. Then by Tsybakov (2009, Theorem 2.2 (hi)) combined with the fact that 
e x n -1 / 2 it follows that the lower rate of convergence for the minimax risk is £ 2as /( 2s + a ) x 

n -as/(2s+a) _ rj 
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